Appendix A describes the Unity-based interface implemented in EVAAA, including an environment setup, prefab structures, and object instantiation. Appendix B provides a comprehensive introduction to Essential Variables (EVs), including their design, dynamics, and role in internal state regulation. Appendix C explains the implementation of the reward system and its connection to the balance of internal states. Appendix E outlines the modular configuration to generate EVAAA environments, along with the instructions for environment customization. Appendix F presents the structure and progression of naturalistic training environments. Appendix G describes the design of unseen experimental testbeds for evaluation. Appendix I provides analyses of agent behavior across training and test environments, including emergent behavioral patterns. All code and data are publicly available at: https://github.com/cocoanlab/evaaa A.1 Prefabs Environmental elements such as terrain, resources, obstacles, and predators are implemented as reusable and configurable Unity prefabs. Prefabs are grouped into Agents, Environment, and Materials. Each category includes reusable components for constructing and customizing interactive scenes: Agents (main agent and predators), Environment (terrain and containers), and Materials (varied textures and colors for visual distinction). This modular system enables rapid prototyping, task generation, condition randomization, and reproducible scene setup. Prefabs can be customized through the Unity Editor or programmatically at runtime, and reused across scenes without manual rebuilding.

The power of foundation models (FMs) lies in their capacity to learn highly expressive representations that can be adapted to a broad spectrum of tasks. However, these pretrained models require additional training stages to become effective for downstream applications. In the multi-task setting, prior works have shown empirically that specific meta-learning approaches for preparing a model for future adaptation through parameter-efficient fine-tuning (PEFT) can outperform standard retraining methods, but the mechanism of the benefits of meta-learning has been largely unexplored. We introduce a framework for generic PEFT-based metalearning to learn a model that can easily adapt to unseen tasks. For linear models using LoRA, we show that standard retraining is provably suboptimal for finding an adaptable set of parameters and provide strict performance guarantees for our proposed method. We verify these theoretical insights through experiments on synthetic data as well as real-data vision and language tasks. We observe significant performance benefits using a simple implementation of our proposed meta-learning scheme during retraining relative to the conventional approach.

The heads are then concatenated to form the LoRA adapter.

The circles and crosses represent the object and goal positions, respectively.

Understanding and reasoning about physics is a hallmark of intelligence [9].

Temporal abstractions in the form of options have been shown to help reinforcement learning (RL) agents learn faster.

Toovercome thelimitation, wepropose Latent Dynamics Mixture (LDM) that trains a reinforcement learning agent with imaginary tasks generated from mixtures of learned latent dynamics.